Papers with Low Rank Adaptation
Towards Robust and Efficient Federated Low-Rank Adaptation with Heterogeneous Clients (2025.acl-long)
Copied to clipboard
| Challenge: | Existing methods for federated fine-tuning for Large Language Models suffer from performance degradation at low ranks in heterogeneous data settings. |
| Approach: | They propose a low-rank adaptive model with Alternating freeze and Adaptive rank selection which reduces the number of uploaded parameters by 99.8% . |
| Outcome: | The proposed low-rank Adaptation maintains robustness even under extreme heterogeneity and low rank conditions while preserving communication efficiency. |
StyleRemix: Interpretable Authorship Obfuscation via Distillation and Perturbation of Style Elements (2024.emnlp-main)
Copied to clipboard
| Challenge: | Authorship obfuscation methods that ignore author-specific stylistic features are often too rigid and lead to degradation of fluency and grammaticality. |
| Approach: | They propose an adaptive obfuscation method that perturbs stylistic elements of text . authors release a large set of 30K high-quality, long-form texts from a diverse set of 14 authors . |
| Outcome: | The proposed method outperforms state-of-the-art methods on an array of domains on automatic and human evaluation. |